医学图像分割模型的性能指标用于衡量参考注释和预测之间的一致性。在开发此类模型中，使用了一组通用指标，以使结果更具可比性。但是，公共数据集中的分布与临床实践中遇到的案例之间存在不匹配。许多常见的指标无法衡量这种不匹配的影响，尤其是对于包含不确定，小或空参考注释的临床数据集。因此，可能无法通过此类指标来验证模型在临床上有意义的一致性。评估临床价值的维度包括独立于参考注释量的大小，考虑参考注释的不确定性，体积计和/或位置一致性的奖励以及对空参考注释正确分类的奖励。与普通的公共数据集不同，我们的内部数据集更具代表性。它包含不确定的，小或空的参考注释。我们研究了有关深度学习框架的预测的公开度量指标，以确定哪些设置共同指标可提供有意义的结果。我们将公共基准数据集进行比较而没有不确定，小或空参考注释。该代码将发布。

Automatic Image Cropping is a challenging task with many practical downstream applications. The task is often divided into sub-problems - generating cropping candidates, finding the visually important regions, and determining aesthetics to select the most appealing candidate. Prior approaches model one or more of these sub-problems separately, and often combine them sequentially. We propose a novel convolutional neural network (CNN) based method to crop images directly, without explicitly modeling image aesthetics, evaluating multiple crop candidates, or detecting visually salient regions. Our model is trained on a large dataset of images cropped by experienced editors and can simultaneously predict bounding boxes for multiple fixed aspect ratios. We consider the aspect ratio of the cropped image to be a critical factor that influences aesthetics. Prior approaches for automatic image cropping, did not enforce the aspect ratio of the outputs, likely due to a lack of datasets for this task. We, therefore, benchmark our method on public datasets for two related tasks - first, aesthetic image cropping without regard to aspect ratio, and second, thumbnail generation that requires fixed aspect ratio outputs, but where aesthetics are not crucial. We show that our strategy is competitive with or performs better than existing methods in both these tasks. Furthermore, our one-stage model is easier to train and significantly faster than existing two-stage or end-to-end methods for inference. We present a qualitative evaluation study, and find that our model is able to generalize to diverse images from unseen datasets and often retains compositional properties of the original images after cropping. Our results demonstrate that explicitly modeling image aesthetics or visual attention regions is not necessarily required to build a competitive image cropping algorithm.

Many scientific domains gather sufficient labels to train machine algorithms through human-in-the-loop techniques provided by the Zooniverse.org citizen science platform. As the range of projects, task types and data rates increase, acceleration of model training is of paramount concern to focus volunteer effort where most needed. The application of Transfer Learning (TL) between Zooniverse projects holds promise as a solution. However, understanding the effectiveness of TL approaches that pretrain on large-scale generic image sets vs. images with similar characteristics possibly from similar tasks is an open challenge. We apply a generative segmentation model on two Zooniverse project-based data sets: (1) to identify fat droplets in liver cells (FatChecker; FC) and (2) the identification of kelp beds in satellite images (Floating Forests; FF) through transfer learning from the first project. We compare and contrast its performance with a TL model based on the COCO image set, and subsequently with baseline counterparts. We find that both the FC and COCO TL models perform better than the baseline cases when using >75% of the original training sample size. The COCO-based TL model generally performs better than the FC-based one, likely due to its generalized features. Our investigations provide important insights into usage of TL approaches on multi-domain data hosted across different Zooniverse projects, enabling future projects to accelerate task completion.

Recent 3D-based manipulation methods either directly predict the grasp pose using 3D neural networks, or solve the grasp pose using similar objects retrieved from shape databases. However, the former faces generalizability challenges when testing with new robot arms or unseen objects; and the latter assumes that similar objects exist in the databases. We hypothesize that recent 3D modeling methods provides a path towards building digital replica of the evaluation scene that affords physical simulation and supports robust manipulation algorithm learning. We propose to reconstruct high-quality meshes from real-world point clouds using state-of-the-art neural surface reconstruction method (the Real2Sim step). Because most simulators take meshes for fast simulation, the reconstructed meshes enable grasp pose labels generation without human efforts. The generated labels can train grasp network that performs robustly in the real evaluation scene (the Sim2Real step). In synthetic and real experiments, we show that the Real2Sim2Real pipeline performs better than baseline grasp networks trained with a large dataset and a grasp sampling method with retrieval-based reconstruction. The benefit of the Real2Sim2Real pipeline comes from 1) decoupling scene modeling and grasp sampling into sub-problems, and 2) both sub-problems can be solved with sufficiently high quality using recent 3D learning algorithms and mesh-based physical simulation techniques.

噪声的去除或取消对成像和声学具有广泛的应用。在日常生活中，Denoising甚至可能包括对地面真理不忠的生成方面。但是，对于科学应用，denoing必须准确地重现地面真相。在这里，我们展示了如何通过深层卷积神经网络来定位数据，从而以定量精度出现弱信号。特别是，我们研究了晶体材料的X射线衍射。我们证明，弱信号是由电荷排序引起的，在嘈杂的数据中微不足道的信号，在DeNo的数据中变得可见和准确。通过对深度神经网络的监督培训，具有成对的低噪声数据，可以通过监督培训来实现这一成功。这样，神经网络就可以了解噪声的统计特性。我们证明，使用人造噪声（例如泊松和高斯）不会产生这种定量准确的结果。因此，我们的方法说明了一种实用的噪声过滤策略，可以应用于具有挑战性的获取问题。

隐私已成为机器学习的主要问题。实际上，联合学习是出于隐私问题而激发的，因为它不允许传输私人数据，而仅传输中间更新。但是，联邦学习并不总是保证隐私保护，因为中间更新也可能揭示敏感信息。在本文中，我们对高斯混合模型的联合期望最大化算法进行了明确的信息理论分析，并证明了中间更新可能导致严重的隐私泄漏。为了解决隐私问题，我们提出了一个完全分散的隐私解决方案，该解决方案能够安全地计算每个最大化步骤中的更新。此外，我们考虑了两种不同类型的安全攻击：诚实但有趣而窃听的对手模型。数值验证表明，就准确性和隐私水平而言，与现有方法相比，所提出的方法具有优越的性能。

线虫秀丽隐杆线虫（秀丽隐杆线虫）被用作模型生物体，以更好地了解发育生物学和神经生物学。秀丽隐杆线虫具有不变的细胞谱系，已使用荧光显微镜图像进行了分类和观察。然而，一旦开始零星的肌肉抽搐，已建立的跟踪细胞的方法就无法概括。我们以方法为基础，该方法将皮肤细胞用作基准标记，尽管随机抽搐，但仍在进行细胞跟踪。特别是，我们提出了一个细胞核分割和跟踪程序，该过程被整合到3D渲染GUI中，以提高在晚期发育过程中跟踪细胞的效率。在三个测试胚胎上描述上述肌肉细胞核的图像上的结果表明，基准标记与经典的跟踪范式结合使用，克服了零星的抽搐。

深度强化学习方法是最近在计算机视觉和机器人技术社区中进行视觉导航任务的流行方法。在大多数情况下，奖励函数具有二进制结构，即当代理达到目标状态时，将提供大量的积极奖励，并为环境中的每个其他状态分配负面的刑罚。这样的稀疏信号使学习过程具有挑战性，特别是在大环境中，需要采取大量顺序动作才能达到目标。我们引入了奖励成型机制，该机制逐渐根据目标距离逐渐调整奖励信号。使用AI2进行的详细实验 - 该模拟环境证明了对象目标导航任务所提出的方法的功效。

深度学习已被证明可以准确评估“隐藏”表型，并从传统临床医生对医学成像的解释之外的医学成像中预测生物标志物。鉴于人工智能（AI）模型的黑匣子性质，应在将模型应用于医疗保健时谨慎，因为预测任务可能会因疾病和患者人群的人口统计学差异而短路。使用来自两个医疗保健系统的大超声心动图数据集，我们测试使用深度学习算法从心脏超声图像中预测年龄，种族和性别，并评估各种混杂变量的影响。我们培训了基于视频的卷积神经网络，以预测年龄，性别和种族。我们发现，深度学习模型能够确定年龄和性别，同时无法可靠地预测种族。不考虑类别之间的混淆差异，AI模型预测性别为0.85（95％CI 0.84-0.86），年龄为9.12年的平均绝对误差为9.12年（95％CI 9.00-9.25），从AUC进行竞赛， 0.63-0.71。在预测种族时，我们表明，在培训数据中调整混杂变量（性别）的比例会显着影响AUC（从0.57到0.84），而在训练性别预测模型中，调整混杂因素（Race）并未实质性更改AUC（0.81-0.83）。这表明该模型在预测种族方面的表现很大一部分可能来自AI检测到的混杂功能。进一步的工作仍然是确定与人口统计信息相关的特定成像功能，并更好地了解医学AI中人口统计学识别的风险，因为它与潜在的偏见和差异有关。

全球抗菌耐药性（AMR）的增加是对人类健康的严重威胁。为了避免AMR的传播，快速可靠的诊断工具可以促进最佳的抗生素管理。在这方面，拉曼光谱学有望在一步中快速标记和无培养物鉴定以及抗菌敏感性测试（AST）。但是，尽管许多基于拉曼的细菌识别和AST研究表现出了令人印象深刻的结果，但仍必须解决一些缺点。为了弥合概念验证研究和临床应用之间的差距，我们与新的数据增强算法相结合开发了机器学习技术，以快速鉴定最小制备的细菌表型和甲氧西林抗甲氧西林（MR）的区别（MR）的区别甲氧西林敏感（MS）细菌。为此，我们为细菌的超光谱拉曼图像实施了光谱变压器模型。我们表明，我们的模型在精度和训练时间方面都超过了许多分类问题的标准卷积神经网络模型。对于六种MR-MS细菌物种，我们在数据集中达到了超过96美元的分类精度，该数据集由15个不同类别和95.6 $ \％$分类精度。更重要的是，我们的结果仅使用快速，易于生产的培训和测试数据获得